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SUMMARY 


Success  Chances  of  REcruits  Entering  the  Navy  (SCREEN)  were  implemented  for  recruit 
selection  on  1 October  1976.  They  relate  an  applicant’s  educational  level,  AFQT  mental  group,  age, 
primary  dependents,  and  race  to  his  chances  of  completing  the  first  year  of  service. 

When  SCREEN  had  been  in  use  for  six  months,  concern  arose  over  the  possibly  excessive 
losses  of  men  with  less  than  1 1 years  of  education  and  men  who  were  between  17  and  17 Vi  years 
old.  Neither  of  these  variables  was  specifically  addressed  in  SCREEN.  A redefinition  of  the  race  or 
minority  factor  also  had  occurred.  Lastly,  further  investigation  of  the  best  statistical  model  for 
screening  had  been  completed. 

These  events  led  to  a reanalysis  of  SCREEN  that  resulted  in  a revised,  improved  version. 
The  revision  uses  the  most  efficient  statistical  model  and  differs  from  the  original  version  in  that 
educational  level  is  further  broken  into  1 1 years  and  less  than  1 1 years  and,  as  a result,  the  race 
variable  is  no  longer  of  consequence. 

The  technical  background  of  the  revision  is  contained  in  this  report,  along  with  recruit 
input  data  and  model  projections  useful  for  recruitment  planning. 
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A REVISED  SCREEN  MODEL  FOR  RECRUIT 
SELECTION  AND  RECRUITMENT  PLANNING 


REASONS  FOR  REVISING  SCREEN 

On  I October  1977,  tables  of  “Success  Chances  of  Recruits  Entering  the  Navy”  (SCREEN) 
were  implemented  for  use  in  recruit  selection  and  recruitment  planning.  The  tables  indicated  the 
chances  of  completing  the  first  year  of  service  given  a recruit’s  level  of  civilian  education,  AFOT 
mental  group,  age  and  dependents  status  at  the  time  of  enlistment,  and  race,  (reference  1). 

SCREEN  had  been  developed  on  non-prior  service  males  who  joined  the  regular  Navy  in  CY 
1973.  and  it  was  successfully  tested  on  a similar  cohort  who  enlisted  in  CY  1974.  Adjustments 
were  also  made  to  take  care  of  the  fact  that  mental  group  today  is  based  on  the  Armed  Service 
Vocational  Aptitude  Battery  (ASVAB)  rather  than  the  Navy  Basic  Test  Battery  (BTB)  that  was 
used  when  SCREEN  was  developed  (reference  2).  The  SCREEN  variables  are  as  follows; 


AFQT; 

95-99 

Years  of  education; 

over  12 

67-94 

12 

50-66 

under  12 

35-49 

21-34 

Primary  dependents; 

Yes 

No 

Age; 

17  years 

18  and  19 

Race; 

Caucasian 

20  or  older 

Non-Caucasian 

By  April  1977,  several  events  had  taken  place  that  led  to  a need  for  reanalyzing  SCREEN 
to  insure  that  it  was  working  as  efficiently  as  possible.  First,  extensive  investigation  of  linear  and 
non-linear  models  for  predicting  losses  from  SCREEN  variables  showed  that  the  best  fitting  as  well 
as  the  cheapest  statistical  model  to  use  with  very  large  numbers  of  observations  was  the  grouped 
logit  model  (reference  3).  A grouped  linear  model  had  been  used  in  the  original  SCREEN;  althougli 
it  made  little  practical  difference  whether  this  or  the  grouped  logit  model  was  used  with  the 
qualifying  score  established  in  FY  1977,  differences  favoring  the  logit  version  were  found  to  occur 
at  higher  qualifying  scores. 

Second,  the  original  SCREEN  had  separate  tables  for  Caucasians  and  non-Caucasians.  In  the 
CY  1973  and  1974  cohorts,  about  90  percent  of  the  non-Caucasians  were  black.  By  1977,  however, 
recruits  of  Spanish  heritage,  who  had  been  categorized  as  Caucasians  in  the  original  SCREEN,  were 
included  in  a redefined  minority  category  that  now  contained  only  75  percent  blacks. 
Consequently,  the  original  SCREEN  non-Caucasian  table  was  being  used  inappropriately. 

Third,  an  unexpected  increase  in  attrition  in  March  1977  at  the  San  Diego  Training  Center 
suggested  that  the  level  of  education  “Less  than  1 2 years”  used  in  SCREEN  should  be  broken  into 
“I  I years”  and  “Less  than  1 1 years”  to  sec  if  loss  predictions  could  be  improved. 
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Finally.  Air  Force  experience  leading  to  a recommendation  not  to  accept  recruits  less  than 
17'/:  years  of  age  made  it  appropriate  to  break  the  SCREEN  age  17  level  into  older  and  younger 
categories  to  determine  the  effeet  on  the  Navy  loss  predictions  (reference  4). 

In  summary,  questions  about  the  best  statistical  model,  the  appropriateness  of  minority 
classifications,  and  the  precision  of  the  lower  educational  and  age  levels  motivated  a new  look  at 
the  original  SCREEN  technique. 

THE  PROCESS  OF  REVISION 

Both  CY  1973  and  1974  cohorts  were  used  in  the  process  of  revising  the  SCREEN  tables. 
The  input  and  loss  rates  for  the  separate  SCREEN  variables  are  shown  for  these  cohorts  in  table  1. 
There  are  sizeable  proportions  of  recruits  who  have  less  than  1 1 years  of  education  and  who  arc 
younger  17-year-okls  in  both  cohorts.  Further,  the  loss  rates  for  these  education  and  age  levels  arc 
the  highest  when  looking  at  education  or  age  alone.  Of  course,  the  purpose  of  the  SCREEN 
technique  is  not  to  look  at  such  separate  loss  rates,  but  ratt’  - to  look  jointly  at  all  SCREEN 
variables  to  determine  the  net  effects  on  loss  rates  of  any  on  cm  when  the  remainder  are  held 
constant.  In  other  words,  the  importance  of  any  one  of  al  variables  for  predicting  attrition 
cannot  be  judged  simply  by  observing  its  separate  relationship  to  loss  rate. 

The  17-year-old  age  level  was  split  between  the  6th  and  7th  month,  because  cumulative  loss 
rates  dropped  noticeably  at  this  point.  This  effect  was  observed  at  the  end  of  recruit  training,  the 
first  year  of  service,  and  the  second  year  of  service  (see  appendix  A,  table  A-1 ). 

To  test  and  compare  the  effects  on  loss  rates  of  the  race  and  redefined  educational  and  age 
variables,  six  different  grouped  logit  models  were  run,  five  of  them  on  the  CY  1973  cohort: 

1.  The  original  SCREEN  that  included  the  race.  “Less  than  12  years”  education,  and  “Age 
17”  variables. 

2.  A revised  SCREEN  that  included  the  race  variable  and  the  split  education  and  age 
variables. 

3.  A revised  SCREEN  without  race  where  the  education  variable  was  split,  but  where  the 
older  17-year  olds  were  grouped  with  18  and  19  year  olds. 

4.  A revised  SCREEN  without  race  where  only  the  education  variable  was  split, 

5.  A revised  SCREEN  as  in  4.,  but  for  the  CY  1974  cohort,  and 

6.  A revised  SCREEN  as  in  4.,  but  at  the  2-year  period  of  service  for  the  CY  1973  cohort. 

The  purposes  of  these  analyses  were  to  establish  a base  line  and  test  the  effects  of  redefining  the 

education  and  age  variables  within  tlie  CY  1973  cohort  and  then  on  the  CY  1974  cohort.  The 
detailed  results  arc  in  appendix  A.  and  a summarization  of  them  is  presented  in  table  2. 

Table  2 contains  the  partial  correlation  coefficients  for  each  variable  in  each  model  and  the 
model’s  summary  statistics.  The  partial  correlation  is  the  correlation  with  loss  rates  for  a dven 
variable  when  the  rest  of  the  variables  are  held  constant.  It  indicates  the  relative  net  importance  of 
the  variable  in  accounting  lor  the  variability  in  loss  rales.  The  variables  in  table  2 are  ordered  in 
descemiing  order  of  importance,  as  arc  the  levels  within  eacli  variable. 
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PARTIAL  CORRELATIONS  AND  SUMMARY  STATISTICS 
FOR  VARIOUS  SCREEN  WEIGHTED  GROUP  LOGIT  MODELS 


4)  5 

<N  U 5 


tn  fO  On 
On  On 


^ O 

00 


KT)  rj 
in 


00  o 

On  — 


r-  . o 

> t ^ 


m ^ 
O'  O' 


fM  «ri  'O 
00  VO  VO  vn 


O O 
'O  fN 


m 

O'  — 


— lAl 
O'  00  rf 


f^i  fO  'O  VO 
00  'O  ^ 


r-  O' 

vi  r-i 


VO  't 

O'  — 


O'  rt  O 

00  00  ^ 


00  VO  O'  O' 

r*  VO  r<^ 


^ 'O 

O'  — 


00  r-i  00 

O'  r~  rj 


r~  ro  vo  — " 
VO  >ri  ro 


JS  X) 

00  00  — 00  O' 

m rj  o O 00 


r-  O 00  t-  — 

r-  vO  </o  'd'  wo 


00  rn 

Tt  r) 


0 r- 

O'  — 


c«  — 

•s  Si.  s 

:!  = a 


^ O'  O'  ^ 
ro  ^ O'  O' 

ill! 

^ in  in 

f-irt  r<>  On  NO 

a 

u. 

< 


O 00 

^ T 

o — ^ 

o 

^ — 


One  level  of  each  set  of  variables  (e.f:..  I 2 years  of  education)  is  contained  in  the  constant  term  of  the  repression  equation  for  each  model;  these  levels  do  not  have 
separate  correlations. 

'Not  statistically  sipnificant;  all  other  variables  are  sicniritant  at  the  95'.».  confidence  level. 

In  loprithmic  torm. 


Across  the  models  in  table  2,  the  lower  educational  levels  emerge  as  the  most  important 
predictors  of  loss  rates:  “Less  than  11”  and  “11”  in  order.  Mental  group  IV  is  the  next  most 
important  predictor.  The  least  important  (and  in  some  cases  statistically  insignificant)  predictors  arc 
race  and  the  17-year  old  (combined  or  split)  age  groups  with  one  exception;  at  the  2-year  point, 
age  17  is  of  much  higher  importance. 

In  the  original  SCREEN  logit  model,  all  variables  were  significant  statistically  at  the  99 
percent  confidence  level.  A revised  model  where  the  education  and  age  variables  were  split  showed 
that  neither  the  older  17  year-old  nor  the  race  predictor  was  significant  (t  values  of  1.22  and  0.19. 
respectively).  This  means  that  splitting  the  “Less  than  12  years”  education  level  in  “II”  and  “Less 
than  1 1.”  subsumes  the  predictive  power  originally  belonging  to  the  race  variable. 

The  third  model  did  not  contain  race,  and  the  older  17  year-olds  were  grouped  with  the  18 
and  19  year-olds.  (The  loss  rate  of  the  older  17  year-olds  was  more  like  that  of  men  20  or  older 
tlian  that  of  18  and  19  year  olds,  but  a grouping  with  20  year-olds  lacked  appeal.) 

The  fourth  model  was  run  with  the  education  split  but  without  the  age  17  split.  Across 
mental  groups,  the  first  year  loss  rates  of  older  and  younger  I 7 year-olds  with  1 1 and  less  than  1 1 
years  of  education  were  quite  similar  (see  appendix  A,  table  A-3).  Only  at  12  years  of  education 
was  tlwre  a difference,  the  older  group  having  about  half  the  first  year  loss  rate  of  the  younger  one 
(12  versus  21  percent).  Thus,  the  12  year  educational  level  is  the  best  discriminator  among  older 
and  younger  17  year-olds  as  far  as  first  year  losses  are  eoncemed. 

All  of  the  variables  were  statistically  significant  at  the  99  percent  confidence  level  in  the 
third  and  fourth  models,  but  the  standard  error  (the  square  root  of  the  mean  square  error)  was 
least  in  the  latter  one  where  the  17  year-olds  were  not  split.  Consequently,  this  model  with  only 
the  education  split  was  the  model  of  choice.'  It  also  has  the  practical  advantage  of  greater 
simplicity  for  use  by  recruiters,  since  it  obviates  the  need  to  calculate  recruit  ages  to  the  nearest 
month  when  using  a SCREEN  table. 

The  variables  in  the  model  of  choice  then  were  analyzed  for  the  CY  1974  cohort  with 
results  that  were  remarkably  similar  to  those  found  for  the  CY  1973  cohort. 

Finally,  the  variables  in  the  model  of  choice  were  used  at  the  2-year  point  for  the  CY  1973 
cohort.  Again  the  results  were  very  similar  to  those  at  the  one  year  point,  except  that  the  age  1 7 
variable  assumed  a greater  importance. 

THE  REVISED  SCREEN  AND  ITS  USES 

The  revised  first  year  SCREEN  is  given  in  table  3.  It  is  based  bn  AFQT  score  intcnals 
which  refiect  the  mental  group  standards  of  the  Navy  Basic  Test  Battery  (reference  2),  the  same 
age  and  primary  dependents  variables  contained  in  the  original  SCREEN,  and  the  expanded  years  of 
education  variable.  The  2-year  revised  version  is  presented  in  appendix  A (table  A-5). 

j " " ' " 

Tlie  R-  aiul  mean  square  error  for  each  successive  step  in  this  model  arc  given  in  appendix  A.  table  A-t. 
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Weighted  group  logit. 


For  planning  purposes,  revised  first  year  SCREEN  tables  containing  the  percentages  of 
non-prior  service  male  recruits  who  joined  the  regular  Navy  in  CY  1973,  1974,  and  1975  are  given 
in  appendix  B.  According  to  which  of  these  years  is  considered  more  representative  of  a prospective 
future  recruiting  year,  the  actual  effects  of  various  SCREEN  qualifying  scores  in  the  base  input 
cohort  can  be  calculated.  For  example,  with  a qualifying  score  of  72  (that  is,  anyone  with  a score 
of  71  or  lower  would  not  be  enlisted),  16  percent  of  the  CY  1973  cohort,  24  percent  of  the  CY 
1974  cohort,  and  5 percent  of  the  CY  1975  cohort  would  not  have  been  admitted. 

Appendix  B shows  the  percentages  of  blacks  who  entered  in  CY  1973,  and  CY  1974  for 
each  revised  SCREEN  score.'  A qualifying  score  of  72  would  have  excluded  28  percent  of  the 
blacks  in  CY  1973  and  31  percent  in  CY  1974,  compared  to  16  and  24  percent  in  their  total 
cohorts. 

.Another  way  to  use  SCREEN  scores  for  recruitment  planning  is  shown  in  table  4.  In 
contrast  to  the  appendix  B tables  of  actual  input  numbers  by  SCREEN  score,  table  4 shows 
predicted  or  model  generated  results  for  each  SCREEN  score.  It  also  includes  the  selection  ratio,  or 
proportion  of  recruits  who  would  be  selected  at  any  qualifying  score  from  the  base  cohort;  the 
'iroportion  of  correct  predictions  (Hits);  the  proportions  of  the  two  kinds  of  wrong  predictions 
(False  positives  or  predicted  successes  who  fail  and  False  negatives  or  predicted  failures  who  would 
have  succeeded);  and  expected  reductions  in  first  year  loss  rates.  For  example,  at  a qualifying  score 
of  72.  about  84  percent  of  the  CY  1973  cohort  would  have  been  enlisted  (selection  ratio).  77 
percent  of  the  selection  decisions  would  have  been  correct  (Hits);  about  13  percent  of  the  cohort 
selected  would  not  have  completed  the  first  year  of  service  (False  positives);  nearly  1 1 percent  of 
the  cohort  would  not  have  been  selected  but  would  have  completed  the  first  year  if  all  cohort 
members  had  been  let  in  (False  negatives);  and  the  first  year  loss  rate  would  have  been  reduced  by 
16  percent  (from  18  to  15  percent).  Note  that  the  selection  ratio  calculated  for  the  same  qualifying 
score  from  the  appendix  B tables  containing  actual  input  values  does  not  necessarily  agree  with 
predicted  value  generated  from  the  model. 

Table  5 is  an  application  of  the  SCREEN  model  to  the  CY  1974  cohort,  one  which  was 
larger  and  of  lower  average  quality  than  the  CY  1973  cohort.  As  an  example,  at  a qualifying  score 
of  72.  only  75  percent  of  the  CY  1974  cohort  would  have  been  enlisted  (vice  84  percent  in  1973); 
72  percent  of  the  decisions  would  have  been  correct  (vice  77  percent  in  1973);  12  percent  of  the 
cohort  would  have  entered  and  failed  (about  the  same  as  in  1973);  15  percent  would  not  h.ave 
entered  but  would  have  succeeded  (vice  11  percent  in  1972);  and  the  first  year  loss  rate  would 
have  been  reduced  by  23  percent  (vice  16  percent  in  1973). 

Tables  4 and  5 illustrate  the  differences  in  application  of  the  revised  SCREEN  table 
depending  upon  the  cohort  under  consideration.  If  specific  information  about  the  supply  of  men 
available  for  enlistment  is  not  known,  recniit  cohorts  provide  the  next  best  alternative  for 
recruitment  planning.  The  choice  of  cohort,  however,  should  approximate  the  expected  market, 
since  wide  variations  in  cohort  size  dnd  quality  occur  as  shown  below: 


' A siniil;it  ilisirihHlitin  of  blacks  for  CY  1975  could  not  be  made  because  s'f  a chanpe  in  and  confusion  of  race  codes  ihat  scat. 


- 7 - 


Percent 


Cohort 

12  or  more 

AFQT 

size 

yrs.  educ. 

50-99 

1973 

67,000 

71 

64 

1974 

83,000 

63 

53 

1975 

73,000 

82 

75 

Finally,  there  is  a standard  error  involved  in  predicting  success  rates  from  the  SCREEN 
variables,  as  there  is  in  any  prediction  system.  This  error  is  about  ±1  percentage  point  at  the  mean 
SCREEN  score  of  the  CY  1973  cohort.  Not  only  do  SCREEN  scores  vary  in  distribution  depending 
on  the  supply  of  recruits  or  cohort  to  which  they  are  applied,  but  they  also  vary  in  precision 
within  any  given  cohort.  These  facts  should  be  kept  in  mind  when  using  SCREEN  for  recruitment 
planning. 
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PREDICTED  RESULTS  OF  USING  REVISED  FIRST-YEAR  SCREEN  MODEL 

ON  CY  1974  COHORT 
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APPENDIX  A 

DETAILED  ANALYTIC  RESULTS 


TABLE  A-1 


17-YEAR-OLD  INPUT  AND  LOSS  RATES 
BY  MONTH  OF  AGE 
(CY  1973  COHORT) 


Age 

No. 

% 

RTC 

1 year 

2 years 

17  years 

0 mos. 

2,450 

13 

13 

25 

42 

1 mo. 

2.291 

12 

14 

29 

49 

2 mos. 

1,632 

9 

13 

28 

48 

3 mos. 

1,407 

8 

12 

27 

46 

4 mos. 

1,215 

6 

14 

28 

43 

5 mos. 

1,197 

6 

15 

28 

45 

6 mos. 

1,144 

6 

14 

27 

43 

7 mos. 

1,178 

6 

11 

23 

37 

8 mos. 

1,336 

7 

9 

19 

28 

9 mos. 

1,540 

8 

9 

18 

27 

10  mos. 

1,650 

9 

9 

17 

26 

1 1 mos. 

1,666 

_9 

9 

17 

26 

Total/average 

1 8,706 

99 

12 

24 

40 

A - 1 


TABLE  A-2 

WEIGHTED  LOGIT  REGRESSION  RESULTS  FOR  VARIOUS 
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Not  sutisucaUy  significant;  all  other  variables  are  significant  at  the  95  percent  confidence  level. 
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APPENDIX  B 


REVISED  SCREEN  RECRUIT  INPUTS 
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